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SUMMARY 



Problem 

Research on pilot skills since World War II has fo- 
cused , generally, on the perceptual-motor components of 
the flying task. Recently, a conception of flying skill 
which emphasizes the pilot's information seeking and in- 
formation processing functions has evolved which supersedes 
and incorporates the older view of flying skill as hand-eye 
coordination. An information processing model was developer 
to provide the basis for the present experimental analysis 
of flying skill. Thus, the objective of this study was to 
use the model to identify the information processing as- 
pects cf the pilot's flying task and to relate them to the 
student pilot's acquisition of flying ability. 



Approach 

An information processing analysis of the pilot s task 
was developed throagh review of the literature in the areas 
of human auditory and visual information processing, and 
task analyses of the pilot's aircraft system management 
functions. Subsequently, experiments were designed and 
executed to isolate information processing skills sensi- 
tive to individual differences and to determine the extent 
of their variability, to explore means for controlling and 
accounting for such individual variability, and to ascer- 
tain the degree to which these information processing tasks 
relate to and may be applied in improving pilot training. 



Results 

In a series of experiments, the importance of the fol- 
lowing auditory and visual information processing variables 
were demonstrated: stimulus duration, stimulus similarity 
interference, response-induced interference, attention, 
digit span, and scanning strategies. A series of studies 
of audiovisual concept formation demonstrated that with 
simple problems, auditory or visual information was equally 



effective when scanning time was unlimited, that visual 
pictorial information was more effective than visual 
verbal information when scan time was severely limited, 
and thr.t there was no measurable effect of audiovisual 
redundancy on concept attainment performance over the range 
of test tasks studied. 



Conclusions and Recommendations 

The results of this exploratory investigation of in- 
formation processing .aspects of the pilot's flying task 
indicated that experimental procedures developed could be 
employed to probe further the nonoptlmal information pro- 
cessing strategies of student pilots and to evolve more 
effective flying training methods. The results suggest 
the high potential of further research in this area for 
improving Air Force flying training. 



PREFACE 



This report represents a portion of the research pro- 
gram of Project 1138, Perceptual Motor and Cognitive 
Components of the Flying Task, Dr. William V* Hagin, 
Project Scientist; Task 113801, Cognitive Components of 
the Flying Task, Dr. Edward E. Eddowes, Task Scientist, 
being carried out by the Flying Training Division, Air 
Force Human Resources Laboratory, Williams Air Force Base, 
Arizona* It is a systhesis of the results of ten experi- 
mental studies of human information processing accomplish- 
ed by the Department of Psychology, Arizona State University, 
Tempe, Arizona, under contract F41609-72-C-0037 with the 
Air Force Hxnnan Resources Laboratory* Dr. Robert C. 
Haygood was the Principal Investigator for Arizona State 
University. Dr. Merrilynn J. Penner and Dr. Edward E. 
Eddowes were Contract Monitors for the Air Force Htrman 
Resources Laboratory. 
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VISUAL AND AUDITORY INFORMATIOH PROCESSING 
ASPECTS OF THE ACQUISITION OF FLYING SKILL 



I. INTRODUCTION 



Basic research on flying skills since the second world 
war has focused primarily on the study of perceptual-motor 
tasks such as pursuit and error tracking (Birmingham & 
Taylor, 1954; Briggs, 1962) and the efficiency of display 
reading (Sleight, 1948). Such research effdrts reflected 
the simplistic view of flying as an integrated sequence of 
scanning and control movement responses. While such an 
approach may have adequately characterized flying skill 
some tw^aty-five years ago, it is simply inapplicable to 
the piloting of modern high speed aircraft. The advent 
of highly sophisticated navigation, flight-control, and 
weapons control systons has produced a dramatic change in 
the pilot's role. 

The military pilot of today functions primarily as an 
executive decision maker; that is, he must be able to pro- 
cess incoming information rapidly and accurately, and to 
make crucial decisions based upon such data. The dynami- 
cally changing nature of the aircraft operating environment 
demands great refinement of basic information processing 
skills much beyond those perceptual -motor responses pre- 
viously considered to reflect flying skill. The relation- 
ship of the pilot to his informational environoent--to the 
environnental sourcer from which he obtains information 
and the information he outputs to his environment- -provides 
the basis for the present approach to flying skill. 

The information processing paradigm would appear to 
provide an heuristic conceptual framework for the experi- 
mental study of flying skill. In contrast to earlier 
orientations which have stressed the development of skill 
as a build-up of habits --either expressed as connections 
between stimulus and response, or as a build-up of response 
tendencies resulting from reward--the present approach 
views the organism as an information processing system. 
That is, the individual dynamically interacts with the 




enviroment by gathering appropriate cue information and 
generating outputs \n accordance with some processing 
algorithm. It should readily apparent that behavioral 
compoi^nts such as short-term memory^ visual scan^ and 
concept identification are of importance in the efficient 
processing of information. While much effort has been 
devoted to the experimental investigation of these areas » 
there has occurred little iniiegration of relevant findings 
and even less application to practiciil problems. It would 
appear that the virtue of the information processing model 
is to provide a conceptual framework, whereby the complex 
interrelationships among various behavioral components can 
be identified and programmatically investigated. Rigid 
distinctions among sensory processes^ perception^ learning^ 
memory » and verbal/motor skills do not provide the level 
of integration necessary for an adequate description of 
behavior in the dynamically changing environment of the 
modern pilot. However , the concept of information flow** 
from the energy environment through receptor systems » oe- 
coding, gating, shunting, and short-term buffer storage, 
to organized long-term storage, retrieval, encoding and 
cOTiparator to language or motor response generation and 
feedback guidance and monitoring--does seem to offer a 
useful framework for the study of flying skill. 

The goal of the present effort was to clarify the role 
of information processing variables in the acquiiiition of 
flying skill. To achieve this end, a combined analytic and 
experin^ental program was undertaken to: (1) identify 
significant information-processing skills required in the 
operation of aircraft, (2; review existing literature on 
laboratory studies of infonration processing; and (3) de- 
sign and execute the necessary experiments to advance 
existing knowledge in directions relevant to pilot train- 
ing. 



II. THE COSCEPT OF INFX)RMATION 



At the outset, it seems necessary to precisely define 
what is meant by information. Typically, one thinks of 
the mathematical theory of coraminication, now commonly 
called information theory (Shannon & Weaver, 1949). Ac- 



cordingly, information theory defines a source from which 
messages originate, a channel through which they pass, and 
a receiver which accepts and accumulates messages. The 
channel has two important characteristics. First, it has 
a limited capacity and second, it is subject to noise which 
distorts the message. An attempt is made to quantify the 
information content of a message in terms of the ntjmber of 
alternative messages that might have been sent and the 
probabilities of the individual messages. The greater the 
number of alternatives, the greater is the receiver's un- 
certainty about which message will be received. The basic 
unit of information, the bit, represents the amount of un- 
certainty in the choice between two equally probable al- 
ternatives. The classic example is the single bit of un- 
certainty in the outcome of the toss of an unbiased coin, 
uncertainty which is resolved by receiving the information 
that the outcome was "heads" or "tails." 

As the nxmber of possible alternative messages in- 
creases, so does the uncertainty. With equally likely 
alternatives, the amount of uncertainty is the logarithm, 
to the base two, of the ntmiber of alternatives. Thus with 
four alternatives, there are two bits of uncertainty; with 
eight alternatives, three bits, and so forth. The alter- 
natives need not be equally likely; if they have different 
probabilities, the less probable alternatives convey more 
information, but the average information for the whole set 
is reduced, in the limiting case, a message telling an 
outcome that is completely certain (that is, an outcome 
which is already known because it was received before or 
in some other way) conveys no information. Such a message 
is said to be redundant. Any message that conveys less 
than the Tiaximum possible information is said to be partial- 
ly redundant. 

Much research during the past two decades has been 
concerned with the evaluation of information- theory con- 
structs as tools for understanding human behavior (cf . 
Miller, 1956; Garner, 1962). Despite the original enthu- 
siasm, (Quastler, 1955), the theory and its constructs have 
not lived up to their initial promise, and interest has 
waned noticeably. Despite its utility in the analysis of 
communication networks, computers, and guessing games, in- 



formation theory provides at best an incomplete model of 
htman information processing. In particular, hxman ccm- 
munication, especially that coimunication which we char- 
acterize as instruction, cannot be described adequately in 
the language of information theory. 

First, except in the most trivial of cases, it is 
never possible to specify the population of alternative 
messages from which a particular message is drawn. The 
listener, told to standby for a radio communication of 
great importance, may or may not have in his expectations 
the message that is subsequently sent. 

Second, information theory does not deal with the 
question of meaning, which is the essential ingredient in 
hiiman communication. No matter how well the message is 
received, it conveys no information unless the reader 
understands the words themselves. For example, much com- 
munication in the training situation is, in fact, devoted 
to the transmission of the meanings by means of definitions 
and combinations of words, phrases, and other symbolic 
expressions • 

Third, the theory does not take into account the op- 
erating characteristics of the hxnnan receiver who, unlike 
the idealized receiver of information theory, deliberately 
selects, rejects, filters, transforms, and forgets incoming 
information. 



Fourth, information theory does not address itself to 
the question of the importance of messages. The various 
messages in a set are usually not of equal importance or 
concern to the receiver, and the various sets of messages 
themselves differ in value. 



And finally, although not directly related to human 
communication, information theory does not permit the 
quantification of the information content of continuous 
signals. Intuitively, complex auditory signals seem 
infonnationally richer than sine waves, but there is no 
direct method of measurement. 



It is apparent that information theory does not pro- 
vide a comprehensive definition of information. Consider- 
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ing the limitations which have been pointed out, a taxonomy 
would seem to be more appropriate. Input inform€ition to 
the human operator can be categorized into several broad 
classes • 

1. Discrete Event Signals , This category is closest 
in meaning to the "information" of information theory. 
Three distinct classes of discrete event signals may be 
defined, although there are cases in which considerabl3 
overlap may exist. 

a. Abstract (Arbitrary) Event Signals . With this 
type of signal, there is no intrinsic relationship between 
the signal itself and the event signaled. Instead, the 
relationship is arbitrary. Much of aircraft communication 
is of this type. Call signs which designate particular 
aircraft are examples of this type of event signal. 

b. Intrinsic Event Signals . With this type of 
signal, there is an intrinsic relationship between the 
signal itself and the event signalled. During a ground- 
controlled approach (GCA) , the communication "turn to 
heading two one zero" bears an intrinsic relationship with 
what is to be done. 

c. Occurrence Statements . Both types of discrete 
event signals require that the receiver knows the nature 

of the system and the population of outcome. When the 
receiver does not have prior information the signal must 
present all such data. 

2. Continuous Level Signals . This category refers 
to those signals which present the quantity or amount of 
a variable, such as speed. One of the most important as- 
pects of skilled performance is the response to continuous^ 
varying indications of quantity, position, direction, and 
velocity. Pilots systematically monitor heading, altitude, 
airspeed, etc., and make corrections to the state of the 
aircraft based on such information. Although certain dis- 
plays may be digitized, the continuous nature of the 
information still remains. 

3. Analog (Pictorial) Representation . One of the 
most common modes of conveying information is to provide 
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the receiver with a picture, model, or map of an object* 
This method is most useful in presenting information that 
is difficult to verbalize; under such conditions, a pic- 
ture may indeed be worth a thousand words. Although the 
usual mode is visual, other modalities (taste, sound, 
etc.) also permit this method of representation. The 
basic limitation of this method is that it can be used 
only with concrete materials; pictorial representation of 
abstract concepts (e.g., "freedom'') may be difficult or 
impossible. 

4. Logical Relationships . This category of informa- 
tion concerns meaning rather than states or events-. Three 
types of logical relationships may be distinguished. 

a. Equivalence Classes . The most obvious case 
of equivalence class information is fi verbal definition; 
e.g., 'Mc power in watts is equal to the product of the 
current and the voltage." Statements of mathematical 
identities also represent equivalence inputs. For simplic- 
ity we will include here messages of nonequivalence, in- 
cluding inequalities such as "A is larger than B," and 
negation. 

b. Inclusive Relationships . A typical relation- 
ship expressed in symbolic logic is that of inclusion- -a 
relationship that states that a particular object or event 
is a member of some well-defined category or class. For 
example, the statement that a T-37 trainer aircraft has 
two engines is an inclusion statement which places the T-37 
in the class of all two-engine aircraft. Note, however, 
that the statement does not specify that these two concepts 
are equivalent. Information of this type occurs frequently 
in training situations. 

c. Relationships of Natural Regularity . Here we 
include statements of sequential and causal relationship, 
for example, information that "A precedes B** or "A causes 
B.'* SucH information may be derived from instruction or 
by an inductive or problem-solving process based on 
repetitive signals. 
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III. HUMAN INFORMATION PROCESSING 



The study of human information processing focuses on 
the relationship of the individual to his informational 
environment "to the sources of information on which he 
draws y and the outputs he furnishes to that environment. 
Within the individual, the input, control, and output pro- 
cessing, as well as the characteristics of the information* 
storage systems are of central concern. 



Categories of Information Processing 

As indicated, human information processing can be 
divided into three categories, input processing, central 
processing, and output processing* Obviously, a clear 
distinction between these three processing categories can- 
not be made since all three are involved in any information- 
processing sequence. Nevertheless, the broad spectrum of 
information-processing research represents a series of at- 
tempts to clarify the functioning of the system by focusing 
on one or another portion of the system, or some combina- 
tion of system elements* 

I nput Processing . As information comes into the 
system, it is first detected, then identified or recognized 
(categorized), and passed on to central processing. The 
mechanisms of identification and recognition involve com* 
ponent processes of gating, decoding, and filtering 
(selective processing or selective attention), comparing, 
and storage • Each of these processes utilizes information 
already stored, and involves various storage mechanisms, 
to be described later. Studies focusing primarily on input 
processing include experiments on signal detection, reaction 
time, speed and accuracy of display reading, pattern recog- 
nition, dichotic listening, visual and auditory short-term 
memory, visual scanning, and psycholinguistics and reading 
studies. 

Central Processing * Despite its flavor of "mentalism," 
most authorities agree that we cannot escape the notion of 
a central processing mechanism, which includes the functions 
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of rehearsal, decision making, reasoning, inductive problem 
solving and concept formation, organization of information 
for storage in memory, and Imagery. The various functions 
of gating, coding, chunking, filtering, comparing, and 
storage also operate in central processing. In addition, 
it is usually prestimed that the selection of output, the 
central monitoring of output (as opposed to monitoring 
which occurs through feedback) , search control and alloca- 
tion o£ attention are under central processing control. 
Representative studies of central processing are reason** 
ably obvious from the list of mechanisms given above. 

Output Processing . While the selection of output may 
be generally considered as a central processing function, 
the actual planning and generation of responses is clearly 
an output function. Overt responses can be categorized 
conveniently into four types: verbal, procedural, control, 
and search. These types of output have been described 
previously and need not be repeated. Verbal output general** 
ly is studied under the rubric psycholinguistics. It is 
of special Importance to note that many studies of input 
and central processing also call for evaluation of the 
speed and correctness of verbal responses. The ability to 
make such responses is not at issue, however, and the re- 
sponses are used primarily as indices of the efficiency or 
speed of other processes. Control outputs are generally 
studied in tracking experiments. Perceptual -motor perform- 
ance in tracking is perhaps the best -studied output 
phenomenon in himian behavior. In the area of search be- 
havior, the primary effort has been ir^ the allocation of 
search time as a function of the informational "richness" 
of a visual pattern. More recently, efficiency of visual 
scanning has come under experimental scrutiny. Orienting 
responses in the human have been studied primarily in 
determining the factors governing "involuntary" allocation 
of attention. 



Information Storage 

Currently, multi-store models are most frequently 
used in research on memory. In typical studies, informa- 
tion retrieval is tested at various intervals following 
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input* Different functions are generally interpreted in 
terms of different storage systems. The majority of con- 
temporary theorists rely on either a dual-storage (Broad- 
bent, 1958, 1971; Crowder & Morton, 1969; Waugh & Norman, 
1965) or triple -storage (Atkinson & Shiffrin, 1969) model* 
While it is not clear that more than a single memory store 
exists (Melton, 1963, 1970) and while the utility of the 
temporal interval of testing as an independent variable 
has been questioned (Craik & Lockhard, 1972) the multi- 
store model provides an attractive structure for the frame- 
work of the present research. 

Recall performance is probably often a joint function 
of several memory systems (Atkinson 6e Shiffrin, 1968, 1971) . 
First, is appears likely that memory can be divided verti- 
cally into (a) a sensory store which lasts only a short 
time and which apparently requires little^ if any, special 
effort on the part of the subject; (b) an active or short- 
term store which consists of the subject's active rehearsal 
and, thus, is dependent on the subject's strategy and 
motivation; and (c) a long-term store which is like the 
sensory store in that it is passive, unlike the sensory 
store, however, it extends for much longer durations. 
Second, it appears that memory can be divided horizontally 
on the basis of the nature of the memory code; i.e., with 
which sensory modality it is most analogous. 

Sensory Storage . Sensory storage is thought to be an 
inherently brief registration of information in a relative- 
ly unanalyzed form prior to the imposition of identities 
upon it. There is now a body of evidence obtained from a 
variety of experimental paradigms supporting the notion of 
sensory storage in both the auditory and visual modalities. 
Neisser (1967) refers to these storage systems as echoic 
and iconic memory, respectively. 

Information in sensory storage is subject to masking, 
erasure, and (or) distortion from additional stimulation 
to the same sensory modality--even if the subject is not 
attending to this additional stimulation (^verbach 6e Coriell, 
1961). Recent studies, however, show little interaction 
between storage at the sensory level and ongoing cognitive 
processes (e.g., classifying irrelevant stimuli during the 
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presentation of the memory items and during the retention 
Interval). This Is to be expected If readout from sensory 
storage were based on more or less unanalyzed features of 
the stimuli. 

Short-Term Storage , Short-term storage refers to the 
subject's rehearsal processes. It Is assumed that short- 
term storage Is limited In capacity and that Information 
in this system is subject to rapid decay when rehearsal is 
prevented. 

Once information is copied into the short-term store 
it is no longer vulnerable to interference from unattended 
external stimulation (Averbach & Sperling, 1961), but it 
is subject to interference from ongoing cognitive process- 
es (Posner & Rossman, 1965) . This result would be expected 
if it were assumed that both recycling of the memory trace 
and cognitive processing were different functions performed 
by the same system (Atkinson & Shiffrin, 1971). 

Long-Term Storage . Long-term storage refers to in- 
formation which is stored on a relatively peirmanent basis. 
Information does not enter Into long-term storage riindomly, 
but rather it apparently is "carefully" placed in an 
organized position so that when one references the parti- 
cular item in loiig-term storage , semantically related in- 
formation is available at the same time. The structure 
of long-term memory and the organization which it imposes 
on incoming stimuli is one of the most intriguing yet least 
understood areas of experimental psychology. 

Information flow diagrams generally depict information 
initially in sensory storage, then transferring to short- 
term storage and finally into long-term storage. However, 
as many of the properties generally attributed to short- 
term storage; e.g., categorization and rehearsal, require 
access to long-term storage, a more credible diagram would 
require two transfer systems from sensory storage: one 
going through short-term to long-term and one by-passing 
short-term and entering long-term directly. 
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Executive Processor 



Unfortunately y the specification of storage systems 
does not address the question of how decisions are made with 
respect to the material to be stored and that to be eliminated. 
Neisser (1967) suggests a central processing system which 
operates over and above the processing systems discussed 
above. Some sort of "executive" is necessary to control 
activities y allocate attention, and to integrate sequences. 
In general the "executive" constitutes all of those cogni- 
tive activities which previously fell under the heading of 
consciousness y attention^ and voluntary mental activity. 



Capacity Limitation 

The processing capacity of the human information pro- 
cessing system is limited in two ways. The first limita- 
tion is in terms of storage capacity; i.e., immediate mem- 
ory for a series of unrelated items is limited to the 
number 7+2. The source of this limitatior appears to be 
restricted to the short-term store. The sensory store and 
the long-tetm store are thought to be high capacity sys- 
tems. The second limitation in capacity is in the rate at 
which information can be processed. The rate limitation 
is thought to reflect a limitation in the executive pro- 
cessor rather than the specific storage systems. 



IV. IDENTIFICATION OF INFORMATION PROCESSING 
COMPONENTS OF FLYING SKILL 



One of the major goals of the present project was the 
identification of significant information-processing skills 
in flying. To do so , a wide variety of docimients were re- 
viewed, and analyzed in an attempt to extract such data. 
These included Air Training Command materials currently 
used in the Air Force's undergraduate pilot training pro- 
gram as well as numerous research documents (Shannon, Waag, 
& Long, 1973; Baum, Goebel, & Smith, 1972, Smode, Hall, & 
Meyer, 1966). Interviews wr -e conducted with numerous 
flight training' personnel at Williams AFB, Arizona. At the 
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Flying Training Division, Air Force Human Resources Labora- 
tory (AFSC), Williams AFB, Arizona, the investigators were 
briefed and given practice in the operation of various 
flight simulation devices. The 82d Flying Training Wing, 
also at Williams AFB, provided the principal Investigator 
a familiarization flight in the T-37 training aircraft. 

Early in the project, it became evident that the 
analysis of individual piloting skills, even though phrased 
in information-processing langiiage, would be largely re- 
dundant with previous analyses of the same character (Kidd, 
1962; Fleishman, 1967). Instead of generating another list 
of skills or tasks which the pilot must perform, the 
decision was made to produce a conceptual model of the 
flying environment which emphasizes the most salient pro«* 
cesses« The resulting analysis represents hr attempt to 
structure the field of information processing as it pertains 
to flying. 



The Informational Environment 

Figure 1 presents a working model of the environment 
composite informational system existing during a routine 
training flight. It is not intended to be comprehensive, 
but rather, an expository device only. 

Input . The student pilot draws information from a 
variety of sources. Indications of aircraft state are 
given by visual cues from cockpit displays and control 
positions, and by kinesthetic cues from control pressures 
and motion accelerations. Auditory cues relevant to the 
state of the aircraft are also provided in the cockpit. 
The instructor pilot provides information directly in the 
fotrm of instructional cues and demonstrations while exter-* 
nal information is obtained from radio communications. In 
addition to information received frOTi external inputs 
during flight, the student also accesses his own stored 
information; tb^t is, his own memory. The student's memory 
contains cognitive and motor information concerning proper 
methods of performing a task, along with their criteria, 
emergency procedures, and other informational items pre- 
viously acquired and stored. 
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Outpuc . Each response of a student pilot can be con- 
sidered an output of infoinnation. In some cases such as 
statements to the instructor and radio communications, the 
information is discrete and verbal. Information is also 
provided to the aircraft through the direct manipulation 
of controls within the cockpit. Such information is like- 
wise transmitted to the instructor who is observing such 
actions and their effects on the state of the aircraft. 
Every control input will in some way alter the state of 
the aircraft, which In turn provides informational cues 
concerning the effect of such inputs. In this manner, a 
feedback loop is completed. Finally, the student engages 
in active search behavior in order to secure necessary in- 
formation which will serve as input cues. 

The physical actions of the pilot in controlling the 
aircraft have been dichotomized by Smode, Hall, and Meyer 
(1966) into procedural and control actions. Procedural 
actions are relatively discrete, intermittent control 
activations such as moving switches and manipulating con- 
trols. A typical procedural action is that of lowering 
the landing gear. Control actions are those which require 
thu pilot to make continuous adjustments so as to control 
directly the flight path of the aircraft. The two types 
of actions are distinguished more in terms of purpose than 
in terms of which control is used. For example, when the 
throttle position is changed to lower speed on landing, 
this is essentially a procedural action. In contrast, the 
throttle can be used as a continuous control device to 
maintain position relative to another aircraft in formation 
flying. 



The Normal Landing Pattern 

As an example of information processing requirements, 
consider the student returning to base under supervision 
of an Instructor Pilot (IP). The student must perform a 
complex sequence of actions in real time using information 
from the sources described earlier. In addition, the 
external environment input must be entered into storage, 
compared to the student .'s knowledge of task requirements 
(which resides in long-term quasi -permanent storage), and 
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used to generate responses in real time so as to oatch the 
required flight regime. While the actions required to land 
the aircraft would take too much space to describe in de« 
tail here, major groups of task elanents include the 
initial overhead approach to the duty ruiway, the pifcchout 
and upwind turn, the downwind leg, the final turn, final 
approach, roundout, touchdown, landing roll, and taxi back 
to the flight line. The student uiust keep in mind the 
verbal information received by radio, such as landing run* 
way, wind and temperature Information, and traffic ad- 
visories. As he approaches for landing, he must repeatedly 
monitor his position and ground track, and such aircraft 
state indicators as airspeed, rate of descent, altitude, 
and heading. Appropriate control actions must be generated 
to satisfy maneuver requirements. Superimposed on these 
continuous tasks are the intermittent procedural actions 
(e.g., lower landing gear, lower flaps) which must be ac- 
complished at specific prescribed points in the landing. 
In addition, the student must be alert continuously for 
indications of hazardous states or malfunctions of the air- 
craft subsystems. 

Since human information processing capacity is limited, 
the siw^dent pilot must shift his attention rapidly to secure 
the information he needs to execute the required procedural 
and control actions. " is usually called a continuous 
control task may be concj^iiuous with respect to the required 
output, but is usually discontinuous with respect to the 
pilot's behavior and his information inputs. Only in 
artificial settings, such as laboratory- type single-dimen- 
sional tracking, can the attention be focused continuously 
on one input channel. In the normal landing pattern the 
student must tine -share inputs since his capacity will not 
permit simultaneous monitoring of several active information 
sources. To do this, the student scans th^ relevant in- 
struments and areas of the external world dne at a time, 
checking each against his concept of the required state 
which must be achieved so that the future position, velocit>( 
direction, and trim of the aircraft will match the maneuver 
requirements. 
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V. RESEARCH PROGRAM 



Within the context of an information processing ap- \ 
proach» a program of research was initiated for the investi- 
gation of components believed to be relevant to flying 
skill. Since the research was basically exploratory in 
nature, a broad spectrxnn of information processing tasks 
were investigated ranging from simple identification of 
nonverbal stimuli to complex rule learning in concept 
formation. The research program was designed to encompass 
three major areas: (a) Sensj^tiyity and Variability — to 
isolate information processing skills which are sensitive 
to individual differences and determine the extent of such 
variability; (b) Control-- to explore means for controlling 
or accounting for such individual variability; and (c) 
Appllcatlo n--to ascertain the degree to which these tasks 
are applicaol^ to pilot training and to provide a mean^ 
for their implementation. The present report deals pri- 
marily with experlsiental results concerned with the first 
two areas. Although the results are based on data obtained 
exclusively from a college student population, there is no 
reason to believe that the present findings do not hold 
for pilot trainees since they are selected exclusively from 
this group. However, to Insure generalizabllity, a longi- 
tudinal effort using pilot trainees at Flying Training 
Division, Air Force Human Resources Laboratory does appear 
to be necessary, especially to investigate the third area 
of concern, applicability to training. 



VI. THE PROCESSING OF AUUIfORY AND VISUAL SIGNALS 



The pilot must continuously process incoming visual 
and auditory signals which emanated from the environment. 
As a result of high processing demands which occur under 
condicions of task overload, it seemed that the investi- 
gation of the memory processes involved in the retention 
of rapidly presented auditory and visual signals would 
prove to be of value. To study the processing of rapidly 
presented information, an experimental paradigm was em- 
ployed; the observer is presented certain information which 

22 



ERIC 



he is required to retain for later recall. It was assxjmed 
that the observer actively processed the information not 
only during actual presentation of the stimulus, but also 
during the time period subsequent to its presentation. To 
aetennine the excent of this processing and its importance 
for subsequent recall, an attempt to interfere with his 
processing was made by presenting an additional interfering 
stimulus. The interfering stimulus was presented subsequent 
to the presentation of the target stimulus. 

Consider the following thought experiment. Suppose an 
interfering stimulus is presented long after the target 
stiTTiulus in a typical experiment in visual information pro- 
cessing. It is not unreasonable to assume that the inter- 
fering stimulus will have a small or negligible effect on 
retention of the target stimulus* If, on the other hand, 
the interfering stimulus is presented shortly after the 
target stimulus, it is reasonable to conjecture that the 
interfering stimulus will produce a decrement in perform- 
ance. In the present work, the effect on memory perform- 
ance of the delay between presentation of the target 
stimulus and presentation of the interfering stimulus was 
investigated in an attempt to obtain a measure of the time 
course of processing. It was hypothesized that when the 
target stimulus was closely followed by an interfering 
stimulus; that is, with no time between the interfer- 
ing stimulus, a maximal decrement in performance would be 
obtained. Furthermore, as the delay of the interfering 
stimulus was increased, performance should improve mono- 
tonically. In this way, measures of the time required to 
process auditory and visual information could be obtained. 



Measurement of Auditory Processing: Stimulus Interference 

Using this experimental paradigm, the processing of 
simple auditory information was studied (Leshowitz & Cudahy, 
1972; Cudahy 6e Leshowitz, 1973) • A pure tone having a 
characteristic pitch was presented, and the observer was 
asked to remember the pitch of the target tone. Following 
presentation of the target tone, an interfering tone was 
presented. The duration of the target tone was 10 msec; 
the duration of the interfering stimulus was 500 msec. One 



second after the presentation of the interfering tone, a 
third tone, called a comparison tone, was presented. The 
comparison tone was either the same or different in pitch 
fran the original target tone. The probability of the 
comparison tone being different was .5. The subject was 
asked to compare ♦•he pitch of the target and comparison 
tone and respond whether or not the comparison tone was 
the same or different. 

The experimental variable of major interest was the 
delay between termination of the target tone and onset of 
the interfering tone. The function relating the probability 
of a correct response and delay of the interfering tone 
provided a graphic representation of the time course of 
processings It was observed that as the delay of the 
interfering tone was increased, the probability that the 
subject correctly identified the comparison tone increased 
monotonically. The finding that identification of the 
comparison was nearly perfect for delays of the interfer- 
ence tone of about 100 msec is in accord with the simple 
notion of interference with processing produced by a 
subsequently-presented irrelevant stimulus. 



Experimental Variables Affecting Processing 

Stimulus Duration . Several experimental variables 
were found to affect the magnitude of the interference 
effects produced by a retroactive masking tone. First and 
most important was the duration of the target tone. The 
Interfering tone produced a decrement in performance only 
when the target tone was very brief. For target tones 
longer than 20 msec, presentation of an interfering tone 
had no effect on performance. These data can be understood 
by assuming that a very brief tone is characterized by a 
few critical features. Presentation of an interfering tone 
decreases subsequent recall of the target tone because the 
critical features of the target tone are not processed when 
an interference tone is presented. Longer duration tones, 
on the other hand, are characterized by a great redundancy 
in information. Thus, long-duration stimuli provide more 
opportunity for the subject to discriminate than critical 
features. Since a retroactive interfering stimulus cannot 
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obliterate all of th^.ae critical features, interference 
effects are less pronounced. 



Channel . Another critical dimension in information 
processing is the channel in which the interference is 
introduced. It is assumed that auditory processing is 
carried out in two independent channels, the left cad 
right ears. To test the assumption of independence of 
channels, the interfering effects produced by a contra- 
lateral interference tone were investigated. This 
means that if the target stimulus is presented to the left 
ear, the interfering stimulus is presented to the right 
ear. On the assumption that processing in the two channels 
is independent, interference exerted by contralateral mask- 
ing tones should be minimal. This result should hold even 
for brief target tones which have been shown to be suscep- 
cible to interfering effects introduced in the ipsilateral 
channel. In accord with this prediction, the obtained 
results showed that the interference produced by a tone 
contralateral to the target was in all cases minimal and 
thus suggested that the two auditory channels were inde- 
pendent. 

Similarity . The similarity of the interfering and 
target stimuli is thought to be an important variable in 
determining the extent to which normal information process- 
ing is altered. In the auditory processing task described 
above, similarity was investigated by varying the spectral 
(frequency) content of the interfering stimulus. A simple 
notion of interference would predict that the greater the 
similarity of target and interfering tone, the greater the 
interfering effects. In the present experiment, however, 
small effects of similarity were found. That is, as the 
frequency separation between target and interfering stimuli 
increased, little or no change in performance was observed. 
Apparently, common elements shared between target and 
interfering stimuli play a very small role in interference 
with auditory information processing. The present data can 
be interpreted as indicating that the role of an inter- 
fering stimulus is to produce a general level of interfer- 
ence. 

The failure to find similarity effects is paradoxical 
in light of the observation that not all extraneous stimuli 
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produce Interference effects. Recall that a contralateral 
interference tone had little or no effect on performance. 
Moreover, similar experiments in the literature demonstrate 
that interfering stimuli entering through the visual mo- 
dality have little effect on recognition of auditory 
stimuli. Apparently, interfering stimuli must be present- 
ed in the same auditory channel as the target tone if they 
are to be effective (Leshowitz, Zurek, & Robbins, 1974), 



Measurement of Auditory Processing; Response-Induced 
Interference 

It should not be assimied that interference with in- 
formation processing can be produced only by stimulus 
events. The subject's own responses can serve as an 
Important source of interference. Several investigations, 
both theoretical and empirical, have been devoted to a 
study of interference produced by the subject's own re- 
sponses. In the first experiment, the effects of informa- 
tion retrieval on recognition memory for pitch were in- 
vestigated (Leshowitz 6c Hanzi, 1973; Leshowitz & Green, 
1973). The observer was presented a list of tonts which 
were to be retained. The list of tones were chosen in the 
frequency region between 250 and 1000 Hz. After presenta- 
tion of the initial stimulus list consisting of either 6 
or 8 tones, the subject was presented 4 or 5 test tones. 
The task of the subject was to determine whether a given 
test tone had been included among those presented initially. 
One-half of the tones in the test set were included in the 
original set. The probability of the subject correctly 
labeling a tone as "old" is called the "hit" rate. The 
probability that the subject falsely labeled a new tone as 
old is the "false alarm" rate. The relative proportion of 
hits and false alarms is used to ccnnpute memory strength 
(d') and gives a measure of recognition memory. 

The purpose of using tones as the test material as 
opposed to simple vocabulary words was to control for 
linguistic associations normally part of the subject's 
language repertoire. In other words, we attempted to 
ascertain the strength of stimulus and response-induced 
interference in a memory task in which prior experience 
does not play a role. The attempt was to obtain a pure 
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measure of interference. 

The results of this experiment were surprisingly 
similar to those presented In the verbal learning litera- 
ture. Specifically, both stimulus-induced and response- 
induced interference effects were obtained. The data 
analysis permitted isolation of precisely the amount of 
interference attributable to stimulus events from what 
portion attributable to response interference. Probability 
of correct recognition as a function of position in the 
original stimulus list provided a meausre of stimulus 
interference. Performance as a function of position in 
the test list provided admeasure of response interference. 

In verbal learning , it is common to find that items 
presented at the beginning of the list and items presented 
at the end of the list are remembered better than items in 
the middle of the list. Such results are the classical 
serial positions effects of "primacy" and "recency," 
respectively. These effects were again demonstrated for 
the memory of pitch. Moreover, the magnitude of these 
serial position effects was related to the amount of time 
allowed the subject to rehearse the items in the stimi^lus 
set. When Items were presented in rapid succession with 
little or no time allowed for rehearsal, the serial posi- 
tion effects differed markedly from conditions in which 
the set was presented at a slower rate. What seems to be 
of prime Importance is the opportunity to rehearse the 
items in the set. 

Analysis of recognition as a function-set position 
showed that Internal sources of Interference may be even 
greater than external sources of interference. The amount 
of interference produced by the subject's own responses 
can be measured by comparing memory performance for items 
presented at various test-set positions. Suppose the 
Initial test item is recognized at near-perfect levels, 
independent of the item's position in the original stim- 
ulus set, and that items further down the test set are 
recognized less well. The decrease in performance as a 
function of position in the test set provides a direct 
measure of response-induced interference. The present re- 
sults shoi^ed a monotonlcally decreasing function of 
recognition performance as a function of test-set position. 
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These results indicate that in testing, the sheer act of 
comparing the test item and a replica of this item in 
memory has a profound effect on memory for other items. 
In other words, the comparison process itself produces a 
marked decrease in recognition performance for other items. 
It appears that response-Induced interference is at least 
as great as stlmilus -produced interference. 

Interference produced by the retrieval of information 
was especially marked when little or no time was allowed 
for rehearsal of the original material. For items where 
rehearsal was impeded by presenting items at a rapid rate, 
subjects had little or no difficulty in recognizing the 
initial test-list items. However, recognition of all 
succeeding items was drastically curtailed. It appears 
that without sufficient time for rehearsal, items in mem- 
ory are particularly susceptible to response-induced inter- 
ference. If the task does not permit sufficient processing, 
this information can be easily wiped out by the observer's 
own responses. This finding has some important practical 
implications to which we shall return in a later section. 

Measurement of Visual Processing; A Partial Repo rt 
Recognition Paradl^i 

In the next series of studies (Leshowitz, Hanzi, & 
Zurek, 1973), several experiments on visual information 
processing were designed using general principles derived 
from the previous studies on simple auditory information 
processing. 

The purpose of the experiment was to determine how 
much of the array the subject could process. A second 
interest was to determine whether a visual interference 
stimulus could produce decremental effects. Also, an at- 
tempt was made to contrast stimulus -induced and response- 
induced interference in processing complex visual arrays, 
and to determine strategies used by observers in processing 
visual arrays, specifically, do observers scan from left to 
right? 

An objective recognition memory paradigm was employed 
in assessing the human information processing capacities 
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governing visual memory. The subject was presented the 
visual array for a brief period. Since it has been shown 
that observers have great difficulties in recalling large 
amounts of visual information, a partial-*report paradigm 
was employed. Rather than asking subjects to report all 
twelve letters of the array, they were asked to report on 
only a partial sample of these letters. Subsequent to 
the array, an indicator tone was presented which signaled 
report of either the upper, middle, or lower row of the 
array. In order to measure memory decay of the original 
stimulus array, an experimental variable of interest was 
the delay between termination of the array and onset of 
the indicator tone. Following presentation of the Indica- 
tor tone, the subject was presented a test list of letters. 
The test list was located to the right of the visual field 
that contained the original stimulus array* The task of 
the observer was to indicate whether or not the test letters 
presented in a given row-column had been presented in the 
original list. If the letter had been presented in the 
indicated position, the subject was instructed to vote 
"old." If this letter had not been presented in the in- 
dicated pattern, the subject was asked to vote "new." As 
before, hit and false alarms rates were computed as well as 
memory strength scores. Recall i.hat memory strength pro- 
vides a direct measure of the degree to which subjects re- 
tain information. 



Experimental Variables Affecting Visual Processing 

Scanning Strategy . A nimiber of significant main ef- 
fects were obtained. First, subjects have a pronounced 
proclivity to scan the visual array from left to right. 
In addition, subjects preferred the middle row in contrast 
to the upper and lower rows. As a result of these biases 
for certain positions, recognition memory for these pre- 
ferred stimulus positions was markedly superior to recog- 
nition of letters in the other locations of the stimulus 
array. Of special note is the observation that these 
biases manifested themselves across all three observers in 
the experiment. 

Delay of Partial-Report Cue . In agreement with the 
classical data on memory decay, recognition performance was 
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a decreasing function of indicator tone delay. For zero 
delay of indicator tone, performance was nearly perfect. 
When the delay was 2 seconds, performance approached near 
chance levels. Thus, it appears that visual information 
contained in complex visual arrays decays in about 2 
seconds. 

Interference Stimulus . In an attempt to interfere 
with normal processing of visual information, a paradigm 
nearly identical to the one described above in the auditory 
information processing experiments was used. Following 
presentation of the stimulus array, a masking stimulus con- 
sisting of a homogeneous array of dots was superimposed on 
the visual array. This retroactive masking stimulvs always 
followed presentation of the visual stimulus array. In 
agreement with our notions developed for interference with 
auditory processing, under all conditions, presentation of 
the masker produced a significant decrease in subsequent 
memory performance. That is, recognition memory for letters 
decreased upon presentation of the masking stimulus. Al- 
though increasing the duration of the original visual array 
from 50 to 500 msec, and thereby permitting greater time 
for processing of the original array, increased performance, 
the addition of a masking stimulus had a significant 
debilitating effect on memory. 

Response-Induced Interference . The final analysis was 
devoted to an analysis of the interfering effects produced 
by the subject's own responses. The function relating 
performance as a function of position in the test set pro- 
vides a direct measure of interference produced by the 
subject's own responses. In marked contrast to the pre- 
vious set of data on recognition memory for pitch, memory 
for items at the end of the list was no less than the 
recognition memory for the test set items at the beginning 
of the set. It appears that retrieval interference is of 
negligible importance when the subject is required to pro- 
cess a visual array. While an immediate explanation of 
the difference between retrieval interference for visual 
and auditory information processing is not apparent, it 
does appear that the highly codable visual array consist- 
ing of English letters is less susceptible to retrieval 
interference. The unidimensional, noncodable auditory 
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pitchy on the other hand, is clearly susceptible to this, 
retrieval interference. On a codability dimension, inter- 
ference associated with the retrieval process becomes a 
less important factor in recognition memory as the informa- 
tion becomes more easily coded. For relatively noncodable 
material, sufficient time for rehearsal of the original 
stimulus list also mitigates the interfering effects in- 
herent in the retrieval process. In summary, opportunity 
to encode a to -be -retained item is of great importance. 
This finding has Important implications for flying training. 



VII. SHORT-TERM RETENTION OF AUDITORY INFORMATION 



A pilot is constantly required to process complex ar- 
rays of information which, in many cases, are presented 
over several communication "channels" simultaneously. The 
channels might be within the same sensory modality (e.g., 
two different messages, t 3 to the left ear and one to the 
right ear) or they might be between two sensory modalities 
(e.g., one message spoken and one message pictorially dis- 
played). For a more concrete example, while listening for 
landing instr ictions from a control tower (auditory channel^ 
a pilot must also maintain visual contact with his instru- 
ment panel (visual channel) , and in addition, commence a 
rather complicated series of movements In preparation for 
landing (tactile and kinaesthetic channels). 

Pilots, then, are apparently able to do several things 
at once. This leads us to some questions: (a) How are 
they able to do it; i.e., what processing strategies are 
they employing? (h) Are the strategies trainable; i.e., 
if we find a trainee deficient in employing optimal 
strategies, can we provide instructions to remedy the dif- 
ficulty? (c) How can we Isolate the processes used so that 
we might construct devices; i.e., simulators, the operation 
of which would permit more efficient and inexpensive train- 
ing? The answers to these questions necessitate research 
with tasks involving multi-channel inputs 
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The Dlchotlc Paradljgn 



Dichotic memory refers to a set of experimental opera- 
tions In which subjects receive two different lists of 
Items simultaneously, one to each ear, with Instructions 
to reproduce as many of the Items as possible following 
list presentation. In studies using these opsarations both 
lists consist of digits and presentation rate typically is 
2 pairs/sec. Subjects tend to report the digits from one 
ear and then the other rather than alternating between ears 
and reporting items according to the order of their presenta- 
tion. The ear-by-ear report pattern suggests that subjects 
monitor (attend to) only one message and report it first 
during recall. They are still able, however, to report 
items from the other ear (although not as accurately) , so 
both digit lists (right and left ear) must have been 
stored initially. 

The dichotic paradigm would further appear to offer 
a fruitful area of investigation as a result of previous 
work by Gopher and Kahneman (1971) in which Israeli Air 
Force cadets were tested using a dichotic listening pro- 
cedure. The results indicated that measured performance 
on this task was significantly related to two flight 
criteria: (1) success--that is, whether a cadet was 're- 
jected from flight training and, if rejected, at what 
stage; and (2) flight assignment --that is, cadets scoring 
higher were assigned to high performance aircraft. Such 
findings suggest that the dichotic paradigm might provide 
a useful laboratory analogue for studying the information 
processing requirements of the flying task. 



Attended and Unattended Messages 

In the first study using the dichotic paradigm, subjects 
were given a sequence of four pairs of digits on each of 
forty-two trials. One member of each pair was presented to ' 
the right ear and one was presented to the left ear. Sub- 
jects were instructed to attend to only one ear during 
presentation and to either: (a) recall first the digits 
received by the attended ear followed by those from the 
unattended ear (Attended-Unattended or A-U report), or (b) 
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recall first the unattended digits and then the attended 
digits (Unattended-^Attended or U*A report) • 

Several interesting findings emerged from this experi* 
ment. The items on the attended ear were more accurately 
recalled than those on the unattended ear regardless of the 
order of report (i.e.^ A-U or U-A). The order of report 
requiring the least switching of attention^ Attended«*Un- 
attended^ produced the most accurate retention. When 
subjects were required to attend to one ear nnd to report 
the unattended ear firsts the attended message was signi-* 
ficantly impaired. 



Verbal and Written Monitors 

The second experiment in this series was a replication 
of the first with the exception that subjects were required 
to monitor the attended message. TWo types of monitors 
were employed, written and verbal. In the written condition^ 
subjects were required to write the attended message during 
presentation, while in the verbal condition subjects were 
required to shadow (report aloud) the attended message dur- 
ing presentation. 

While the attended message was recalled with equal 
accuracy by both groups » the unattended message was more 
accurately recalled by the written monitor group. Apparent- 
ly ^ when one must encode (store) and decode (output) with 
the same system (auditory-verbal) » greater interference 
results than when different systems (auditory and manual) 
are employed. 



Digit Span 

There occurred considerable bed^een-subjects variability 
in the first experiments. The primary source of variability 
was in errors of omissions; i.e.^ some subjects recalled 
more items than others. Some subjects were overloaded with 
messages containing 4 digits per ear while others managed 
to store and output the information with high accuracy. 
Some subjects, therefore » appeared to have a greater storage 
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capacity than others. In an attempt to control for storage 
capacity. Individual digit span tests were administered In 
the next experiment. Each subject received five digit 
span assessments, and groups with digit spans of 5, 6, 7, 
8, 9, and 10 were formed. 

In this study, the correlation between digit span and 
overall dlchotlc performance (I.e., collapsed over attended 
and unattended ears) was +.891. Digit span, therefore, 
was Identified as a potent source of variability In dlchotlc 
research. Further correlations were run between digit span 
and attended ear and unattended ear In both A-U and U-A 
reports. The highest correlations were obtained on the 
unattended ear; I.e., where switches of attention occurred 
between Input and output. 



Interference Effects In Dlchotlc Memory 

In the first three experiments, different serial posi- 
tion functions were obtained for attended and unattended 
ears. Serial position functions for the attended ear were 
relatively flat (all positions were recalled with approxi- 
mately equal accuracy), while unattended ear serial position 
functions showed a marked recency effect (Items In the 
terminal positions were recalled with greater accuracy than 
Items occurring In the primary serial positions). 

In the next experiment, we investigated the effect of 
a redundant auditory element (stimulus suffix) at the end 
of each dlchotlc list. Previous work has indicated that 
such a manipulation interferes with information which has 
not been fully processed. In this experiment, unattended 
ear recall accuracy was found to be significantly impaired 
when the locution "uh" was presented binaurally at the end 
of the list. Furthermore, the magnitude of the effect ap- 
peared to be a function of digit span. 

Although a relationship between stimulus suffix effect 
magnitude and digit span was not expected, digit spans were 
assessed and the two subjects with a low digit span were 
found to have experienced more interference than the two 
subjects with high digit span. 
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Digit Span and Interference 



IWo groups of subjects were run In the next experiment. 
One group consisted of subjects with high digit spans (X » 
9.75) while the other contained only subjects with low 
digit spans (X » 6.25). The subjects participated in two 
test sessions • In the first session^ subjects received 
dlchotlc lists consisting of five pairs of digits. In the 
second session^ a stimulus suffix was presented blnaurally 
at the end of each dlchotlc list. Subjects with high digit 
spans showed reliably less Interference than did those with 
low digit spans. 

In yet another condition^ the high span subjecco were 
given dlchotlc lists consisting of six pairs of digits with 
and without the addition of a stissulus suffix. The Inter- 
ference produced in that experiment (6 pairs) was comparable 
in magnitude to that of the low span subjects in the last 
experiment (5 pairs). This relates back to the problem of 
task overloading mentioned earlier. Apparently^ the effect 
of a stimulus suffix is to add more information to the task. 
For those subjects whose capacity was already overloaded 
without the suffix, the effect of the suffix was to radically 
degrade recall accuracy. For subjects whose capacity matched 
the condition without the suf flx» the effect of the suffix 
was minimal. The implications of these findings in th^ 
improvement of Air Force flying training will be considered 
further in a later section of this report. 



VIII. AUDIOVISUAL CONCEPT FORMATION 



In ordinary language, the word concept has many mean- 
ings, referring among other things to inner images or ideas, 
to abstract relationships among environmental properties or 
events, to operations wnl^h an organism performs on stimu- 
lus inputs, and so forth. Au:r>ng experimental psychologists, 
however, the term has come to have a more precise, but 
limited, meaning: a principle by which all objects or 
events can be classified into two categories, examples of 
a concept ( positive instances) and nonexamples ( negativ e 
Instances) . Concept formation concerns the learning or 
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utilisation of such classification principles. Thus^ 
studies of concept formation are usually comlucted within 
the framework of a task in which the subject must sort or 
classify a set of stiaulus patterns into categories. The 
**probleoi/' as it is usually called^ is for the subject to 
learn or discover the correct principle for sorting^ using 
information provided by tho stimulus patterns and by cor«- 
rective fee':^back signals given after ^ach sorting response. 

Experimental procedures used in the study of concept 
formation almost universally require the subject to dis- 
cover or infer the correct concept from a series of positive 
or negative instances. While there are many variations, 
most 'procedures fall into one of two classes » depending on 
whether the experimenter chooses the sequence of stimulus 
information ( reception paradigm) or the subject has an 
artlve role in selecting each stimulus to be examined 
( t election paradigm) • 

All of the studies to be reported here have used the 
reception paradigm* The distinguishing aspect of reception 
iis^xnlng is that the subject has no control over the 
selection and ordering cf stimuli. On each of a series 
of trials, the subject is presented with a stimulus pattern, 
is required to classify it (as a positive or negative in- 
stance), and is told whether his response was correct or 
not (informative feedback) • Trials proceed in this fashion 
until the subject can show his knowledge of the correct 
classification principle, either by verbal statement or by 
meeting an arbitrary performance criterion such as 15 con- 
secutive correct responses. Conventional performance 
measures are the number of errors made, the number of trials 
to last error, or the amount of the time taken to reach the 
criterion of problem solution. 

Two structural features of concepts can be Identified « 
The first is a set of one or more specific, perceptible 
stimulus properties which constitute the defining properties 
of the concept* Conventionally, these are called the 
relevant attributes , in contrast to other characteristics 
which vary from pattern to pattern, but have nothing to do 
with the concr "t and are therefore called irrelevant at - 
tributes . The second feature is a conceptual rule which 
specifies how the attributes are combined or otherwise 
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elaborated to form the concept. For v cample, in the con- 
cept "red triangle," the class of all things which are both 
red and triangular, the relevant attributes are redness and 
triangularity* But the concept also includes a particular 
relationship between these two attributes, that of conjunc- 
tion or joint presence. Only those patterns which are both 
red and triangular are examples of the concept. The same 
pair of attributes may be related by a variety of other 
rules, such as inclusive disjunction (either red or square 
or both) . 

Selection of two attributes as relevant in a concept- 
learning problem generates a contingency table consisting 
of the four categories of stimulus patterns defined by the 
presence or absence of the two attributes. For example, 
given red and square as attributes, the four contingencies 
are red square, red not-square, not-red square, and not- 
red not -square. This contingency table is equivalent to 
a truth table in symbolic logic, in which the four contin- 
gencies are designated TT, TF, FT, and FF (T standing for 
true and F for false). The specification of a logical rule 
further maps these four contingencies into a two-response 
system of examples and nonexamples of the concept. For 
example, in a conjunctive concept, the first contingency 
(TT, or red square) is placed in the positive category 
while the other three are negative. The four basic two- 
dimensional rules are shown in Table 1; the plus and minus 
signs indicate that the instance is positive or negative, 
respectively. 

Haygood and Bourne (1965) pointed out that essentially 
all studies prior to that time had used instructions which 
may be characterized as attribute identification. In at- 
tribute identification, the conceptual rule is carefully 
explained to the subject, and his task is to discover the 
relevant attributes. Haygood and Bourne developed an 
alternative procedure, called rule learning, in which the 
subject is told the relevant attributes and must discover 
the correct rule of combination. With the exception of 
the audiovisual redundancy experiment, all of the experi- 
ments to be reported here used attribute identification 
instructions. The rule-learning procedure will be described 
later. 




The study of auditory concept formation is a relatively 
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recent enterprise , beginning only about 15 years ago. Thus, 
little is known about the process except for a few basic 
studies of abstract auditory concepts. The purpose of the 
series of experiments to be reported here is to extend the 
study of audiovisual concept learning to meaningful ccnn- 
parisons of learing from auditory and visual materials. 

Concept Identification in Three Modalities 

In the training situation, the trainer has the option 
of presenting his materials in any one of three modalities. 
These modalities are pictorial, in which pictures of the 
concepts or relationships to be learned are shown, visual 
verbal, in which verbal descriptions of the pictorial 
materials are shown, and auditory verbal ^ in which the 
verbal materials are presented orally or by recording. 
The same material can also be presented in two or all 
three modalities, creating what is called audiovisual 
redundancy; redundancy is covered in later experiments. 

Despite existing folklore to the effect that "one 
picture is worth a thousand words," there is little in the 
way of scientific data to support such a contention, and 
some recent theories of infoinonation processing suggest that 
discrete pictorial information is recoded to verbal form 
for storage and utilization in human information processing. 

In any training program, the goal is to teach the 
trainee concepts by having him read printed verbal materi* 
al', telling him about concepts, or showing him examples 
and nonexamples of concepts. The purpose of the first 
experiment was to provide a direct comparison of concept 
learning in these three modalities. 

The standai I concept-formation procedure was used, in 
which the subject's task is to discover the correct concept 
by being shown a series of positive and negative instances, 
guessing their classifications, and receiving corrective 
feedback. Each subject learned under one of the three 
modalities described above (pictorial, visual verbal, and 
auditory verbal), a concept constructed with one of two 
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rules (conjunction or Inclusive disjunction) and one of 
two pairs of relevant attributes (blue-trlangle or two- 
squares). In the visual conditions , the subject was shown 
a card containing the stimulus pattern. After his response^ 
feedback was given by telling the subject If his response 
was correct or not, and by placing the card face up In the 
correct one of two sorting boxes (positive and negative 
Instances) placed on the table directly In front of the 
subject. In the auditory condition, the subject was told 
what the pattern was; no cards or sorting boxes were used, 
and the subject's feedback consisted only of being told the 
correctness of his response. Subjects worked at their own 
speed, and instructions stressed accuracy rather than speed. 

The results showed clearly that learning is faster for 
conjunctive concepts, and for problems using blue and tri- 
angle as relevant attributes. However, in contrast to the 
striking results for these variables, modality of presenta- 
tion had little effect, and the effect was not statistically 
significant overall. Post hoc analysis showed a slight, but 
significant superiority for visual verbal over auditory 
verbal conditions. It was decided to suspend judgment con- 
cerning modality differences until a second experiment 
could be performed which would eliminate the possible role 
of the sorting boxes in the superiority of the visual con- 
ditions. 



Comparison of Visual and Auditory Verbal Presentation 

This experiment was designed to eliminate the confound- 
ing caused by the fact that subjects in the visual verbal 
conditions could see the last positive and the last negative 
Instance (in the sorting boxes), while subjects in the 
auditory conditions did not have such a memory aid. This 
type of memory aid has been shown to Increase efficiency 
of learning in previous research. 

The purpose of this experiment was to compare three 
types of verbal presentation. The first is the visual 
verbal condition of Experiment 1, with the sorting boxes 
eliminated. The second was the auditory verbal condition 
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of Experiment 1. The third was an augmented auditory 
verbal condition, in which the information gained on each 
trial was repeated at the end of each trial (e.g., "the 
last pattern, one large red square, was a positive in- 
stance). The task and procedure were essentially the same 
as those of Experiment 1, with the changes noted above. 
In addition, the disjunctive concepts were eliminated, and 
all concepts were conjunctive. 

The results showed no significant differences among 
the three modality conditions, indicating that the superior 
performance in visual conditions of Experiment 1 resulted 
from the memory aid provided by the previous instances 
showing in the sorting boxes. Taken together, the two ex- 
periments provide a clear picture. For simple concepts, 
presented in a relatively uncluttered context (few irrele- 
vant stimulus dimensions and discrete and easily identifi- 
able levels of the relevant dimensions) , there is essentially 
no difference between seeing the stimulus patterns, seeing 
a verbal description of the patterns, and being told the 
verbal description. This finding provides a baseline from 
which to examine mora complex visual concepts, such £iS the 
appearance of the runways when the aircraft reaches the 
proper point for turn to final approach, concepts for which 
verbal presentation may not be as informative as visual 
presentation. 



The Effects of Limiting Inspection and Response Time 

The first two experiments indicated that modality of 
presentation has little or no effect in this type of con- 
cept-formation task when unlimited time is available to 
exan.ine stimulus patterns and formulate responses. It is 
well known that limiting inspection-response time has a 
degrading effect on performance in visual problems. Any 
differences in the rates at which pictorial', and verbal in- 
formation can be processed should show up in this type of 
experiment if the time allowed to examine stimuli and re- 
spond is limited. The purpose of this experiment was to 
compare performance in visual verbal and pictorial conditions 
when time constraints are imposed. Unfortunately, a suitable 
method for controlling "inspection time" for oral presenta- 
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. tlon has not as yet been devised , so this condition could 
not be tested. 

The method was essentially the same as that used in 
the first experiment , with the exception that automatic 
equipment with slide projection was used in place of manual 
presentation of cards. This change was made to provide 
control of timing. The subjects' responses were made by 
pressing pushbuttons , and feedback was given by turning on 
a lamp directly over the correct pushbutton. Each subject 
learned either from pictorial stimuli or printed (and pro- 
jected) verbal stimuli under one of three timing conditions. 
The three timing conditions were 1.0 sec, 3.0 sec, or un« 
limited time to inspect the stimulus and respond. Many 
subjects were unable to respond during the 1.0 and 3.0 sec 
intervals until the concept had been learned; however, all 
but seven subjects were able to complete the task satis- 
factorily. 

Limiting the presentation-response time severely de- 
graded performance, and the degradation was far worse for 
verbal conditions than for pictorial conditions. For the 
pictorial conditions, performance at 3.0 sec was actually 
slightly, but not significantly, better than performance 
with unlimited time. The simplest explanation of these 
results would be that it take^? longer to read an^ extract 
the information from the verbal slides than from the 
pictorial slides. A follow-on pilot study supported this 
interpretation by showing that it takes subjects 0.2 sec 
longer to make a simple identification response (e.g., '*is 
this next pattern blue triangle'') when the pattern is verbal, 
compared to pictorial. Further research with a variety of 
different materials is needed to substantiate this pilot 
finding. 

These results suggest that when discrete patterns must 
be presented quickly, as would be the case when large 
amounts of discrete stimulus information must be presented 
in a short period of time (as in a briefing), pictorial 
presentation should be used i.i preference to visual verbal 
presentation. Obviously, further research is needed to 
establish whether these baseline findings can be generalized 
to the more complex conceptual materials used in flying 
training. 
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Audiovisual Redundi.ncy 



Redundancy exists when the same Information Is given 
In two or more different ways. In concept-formation 
studies using pictorial stimulus materials , stimulus re- 
dundancy has been shown to be beneficial under a wide 
variety of task conditions* Al though It Is widely believed 
that providing auditory (verbal) Information which Is re- 
dundant with pictorial Information Is highly beneficial In 
learning, there is very little evidence to support this 
belief* The purpose of this experiment was to determine 
If presenting redundant auditory Information would improve 
performance over that found with pictorial presentation 
alone. 

Two methods of introducing auditory redundancy were 
used. The first was to describe to the subject the exact 
pattern he was seeing (e.g., "the pattern on this card is 
one large red square**). This added redundancy information 
was not expected to aid performance , since the stimulus 
characteristics showing on the card were obvious to all 
subjects* The second method of adding redundancy was to 
describe to the subject the truth table** representation 
of the stimulus pattern, as shown in the first two colxmans 
of Table 2 (e.g., **this pattern is not-blue, not-triangle**) • 
TWO rules were used, inclusive disjunction and biconditional. 
It has been proposed that much of the extreme difficulty of 
the biconditional rule results from the inability of the 
unskilled subject to recode the stimulus pattern to its 
truth-table representation. If this is the case, then 
teaching the subject its representation should help perform- 
ance. 

Each subject learned either a disjunctive or bicondi- 
tional concept under one of three redundancy conditions 
(no redundancy, complete pattern descrption, or truth-table 
description). The results showed no significant difference 
for the three redundancy conditions. If anything, perform- 
ance without the ve bal cue was slightly superior, suggest- 
ing the possibility that the verbal cues may have distracted 
subjects from thetask. The results make it clear that 
descr:/bing to rhe subject what he is seeing is of no help 
when the stimulus materials are simple and schematic as they 
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are in these experiments. Even with the much more difficult 
biconditional rule, there Is no benefit, a finding which 
tends to contradict previous interpretations of bicondition* 
al difficulty as stemming from inability to reduce stimulus 
patterns to truth-table categories. 



Redundancy with Nonconjunctive Concepts 

Previous studies of stimulus redundancy in multidi*^ 
mensional concept formation had always used conjunctive 
concepts in which every combination of levels of the 
relevant dimensions was represented by a separate response 
category. For example, with color and shape relevant, 
using two-level dimensions, the four response categories 
might be red squares, red triangles, green squares, and 
green triangles. Three-level dimensions had never been 
studied, nor had the more common two-category response 
scheme used in these experiments, in which the positive 
category is defined by one attribute combination (e.g., 
red squares) and all other combinations form the negative 
category. Finally, redundancy in disjunctive concepts had 
not been studied. The purpose of this experiment was to 
extend previous findings to tht: two-choice response scheme, 
to disjunctive concepts, and to stimulus dimensions with 
more than two levels. 

The task and procedure were essentially the same used 
in the first experiment. Each subject learned one of three 
classification schemes, two-choice conjunction, four -choice 
conjunction, and two-choice inclusi^^e disjunction. Redun- 
dancy was introduced by correlating the levels of the 
stimulus dimensions; for example, if size and number were 
redundant, small patterns were always single, medium pat- 
terns double, and large patterns triple. Two levels of 
redundancy were used, zero redundancy and two redundant 
relevant dimensions (e«g., size redundant with number and 
color redundant with shape). The intermediate condition 
of one redundant dimension was not used. 

The results confirm and extend previous findings in 
the study of redundancj . There is a redundancy gain under 
all conditions, and th"^ gain is greater for the more dif- 
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flcult problems. These results thus provide no surprises , 
and it appears that previous findings can be generalized 
to nonconjunctive rules and to different kinds of response 
schemes* 



IX. IMPLICATIONS OF INFORMATION PROCESSING 
FOR FLYING TRAINING 



yisual and Auditory Scanning and Interference 

The present work clearly demonstrates that events 
emanating from both the external environment and the 
subject's own processing of information produce delilitat- 
ing effects on memory. We have shown that stimulus events, 
extraneous to the task, when presented in close temporal 
proximity to the actual information processing, cause this 
processing to be ineffectual. Similarly, the sheer act of 
evaluation and comparison of stimuli interferes with recall 
of previously processed material. In other words, inter- 
ference with processing is both a self-induced and exter- 
nally-induced phenomenon. 

The empirical findings suggest several guidelines for 
preventing interference with information processing. For 
example, if the interfering event is delayed with respect 
to the initial processing, the extraneous stimulus wiJl 
have little effect on performance. Similarly introduction 
of a potentially interfering event to a processing channel 
independent of the channel involved in active processing 
will hardly affect performance. In addition, it has been 
shown that apprsciable rehearsal of the to-be-learned 
material can attenuate interference with processing. These 
summary statements appear to govern information processing 
of both simple and complex material presented to auditory 
and visual modalities* 

The obtained data have direct implications for flying 
training. For example, in flying an aircraft, decisions 
are based on information obtained from scanning a control 
panel. Can we instruct the pilot as to the optimal strategy 
for processing arrays of visual information? The answer 
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appears to be affirmative. Recall that the results of the 
visual information-processing experiment described above 
indicated that observers tended to have consistent stra- 
tegies for visual scanning. In the auditory experiment 
it was observed that when rehearsal of items in memory is 
permitted, memory for this information was facilitated. 
And finally, a comparison of the auditory and visual pro- 
cessing experiments strongly suggested that when information 
is amenable to verbal coding, as was the case for memory 
for English letters, interference emanating from retrieval 
processes is minimized. 

Let us now apply the empirical results in developing 
an optimal scanning procedure. Scanning should proceed at 
a slow but steady rate, allowing processing of such suc- 
cessive* items of information on the control panel. The 
attempt here should be to allot enough time, say a fraction 
of a second, for processing and rehearsing of each reading 
on the control panel. Each instrument reading should be 
fully coded before additional information is scanned. A 
verbal code, rather than a pictorial or figural representa- 
tion in visual memory, is required if subsequent recall is 
to be maximized. Observe that the process should be serial, 
with information being processed item by item. Obviously, 
a great deal of additional research needs to be devoted to 
developing actual teaching methods for imparting this 
strategy to student pilots. The important issue here is 
that such an approach lies within the bounds of educational 
technology. 

It is further speculated that nonoptimal scanning 
strategies are employed by student pilots in scanning and 
processing control panels. It is proposed that follow-up 
research be devoted to examining the ac^tual visual scans 
of the eyeball when processing information in the cockpit. 
This can easily be carried out with existing physiological 
recording instruments. Physiological scanning data could 
be correlated with actual flying performance measured 
either in the simulation laboratory or in actual flight. 
The effort would focus on defining the relationship between 
objective measures of scanning with actual information 
processing. 
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Auditory-Verbal Information Processing 



Research by Gopher and Kahneman (1971) Indicated 
potential utility of tasks employing selective attention 
and short-term memory for predicting an Individual's chance 
of success In pilot training. Several advances were made 
In this area In the present research employing dlchotlc 
listening* First , approximately 80% of the variance In 
dlchotlc performance was accounted for by digit span. This 
result suggests that digit spans should be assessed for 
pilot trainees In a longitudinal screening study. This 
can be accomplished with minimal demand of trainee time. 
Twenty or thirty members of a class could be tested at a 
time and only 13-20 minutes would be required for test ad- 
ministration. The predictive value of digit span could be 
assessed in several classes. If it were found that trainees 
with lower digit spans had a higher probability of being 
dismissed from the program two approaches could be taken. 
First, digit span could be used as a screenlvig device for 
the program. In this approach, a minimton d5.glt span (e.g., 
7 digits) would be set up as a criterion for admission 
into the program. Those falling below that digit span 
would not be selected. Second, an information processing 
training program could be initiated for individuals with 
a low probability of completing pilot training. These in- 
dividuals could be given training in tasks involving 
selective attention and short-term memory with the aim 
that some of these abilities can be improved with practice. 
In this latter case, the digit span data would be used as 
a screening device for additional training and not for 
dismissal. 

Another major advance in the present research was the 
finding that a redundant acoustic locution at the end of a 
stimulus list (stimulus suffix) Interfered with the reten- 
tion of items thought to be relatively unanalyzed following 
stimulus presentation. Further, the magnitude of the im- 
pairment was in direct proportion to the disparities between 
an individual's digit span and the number of digits in the 
series presented for auditory processing. 

Previous research with stimulus suffix effects has 
indicated that the greatest impairment of retention occurs 
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when the suffix is physically similar (sane pitch, inten* 
sity^ and tempo) to the stimuiuu list* Consistent with the 
present research these data point up some implications for 
transmitting auditory -verbal information. The capacity for 
receiving information is sharply limited. To be effective 
it is suggested that messages be kept short. The suffix 
experiments suggest that if two messages are to be received 
in rapid succession, it would be more efficient if the 
second message were spoken in a different voice or at a 
different intensity than the first message. This enables 
the pilot to rapidly shift attention to the second message 
and precludes loss of some first message information due 
to second message presentation. 



Audj.oviusal Concept Formation 

The concept-formation studies conducted as part of 
this research program employed problem-solving methods 
comparable to those used in the popular "learning -by- 
discovery'* techniques. They are directly applicable to 
Instructional situations in which the subject is attempt- 
ing to learn, by trial-and-error or discovery, simple con- 
cepts representing compounds of discrete stimulus elements. 
Two major findings are evident from the present research. 

The first finding stems fvcm the experiments comparing 
visual and auditory presentation. The results show clearly 
that, with simple problems using discrete stimulus charac- 
teristlcfc', it makes no difference whether the subject 
receives the Information through pictorial, printed verbal, 
or auditory- verbal methods --provided there is unlimited 
time to inspect the stimulus pattern and generate a response. 
When inspection/response time is severely limited, pictorial 
presentation is superior to printed verbal presentation, 
apparently because it takes longer to read and understand 
the words than to abstract the same ^material from a 
pictorial stimulus. 

The second major finding concerns audiovisual redun- 
dancy. Describing simple visual patterns verbally to the 
subject is of nj benefit and may, in fact, distract the 
subject so as to Interfere with performance* Considered 



in the light of previous research, this finding suggests 
that "show-and-tell" is of benefit primarily with complex 
materials y or materials in which the relevant visual 
characteristics are either obscure or change rapidly over 
time. 



Conclusion 

The present work has developed several principles 
underlying information processing of visual and auditory 
stimuli* We refer to the principles of channel capacity, 
rehearsal, coding, stimulus and response-induced interfere 
ence* As a direct result of this work, tools have been 
made available with which to probe nonoptimal processing 
strategies of student pilots and to teach more effective 
techniques for flying. The follow-up research to the 
present program will include a greater emphasis on informa- 
tion overload and continuity in the task. 
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